EVALUATING MATRIX FUNCTIONS BY RESUMMATIONS ON 
GRAPHS: THE METHOD OF PATH-SUMS 

P-L GISCARDt, S J THWAITEt, AND D JAKSCHt* 

Abstract. We introduce the method of path-sums which is a tool for analytically evaluating 
a function of a square discrete matrix, based on the closed-form resummation of infinite families 
of terms in the corresponding Taylor series. If the matrix is finite, our approach yields the exact 
result in a finite number of steps. We achieve this by combining a mapping between matrix powers 
and walks on a weighted directed graph with a universal graph-theoretic result on the structure of 
such walks. We present path-sum expressions for a matrix raised to a complex power, the matrix 
exponential, matrix inverse, and matrix logarithm. We present examples of the application of the 
path-sum method. 
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1. Introduction. Many problems in applied mathematics, physics, computer 
science, and engineering are formulated most naturally in terms of matrices, and can 
be solved by computing functions of these matrices. Two well-known examples are 
the use of the matrix inverse in the solution of systems of linear equations, and the 
application of the matrix exponential to the solution of systems of linear ordinary 
differential equations with constant coefficients. These applications, among many 
others, have led to the rise of an active area of research in applied mathematics and 
numerical analysis focusing on the development of stable and efficient methods for the 
computation of functions of matrices over M or C (see e.g. f^). 

As part of this ongoing effort, we introduce in this article a novel symbolic method 
for evaluating matrix functions / analytically and in closed form. The method - 
which we term the method of path-sums - is valid for square discrete matrices, and 
exploits connections between matrix multiplication and graph theory. It is based on 
the following three central concepts: (i) we describe a method of partitioning a matrix 
M into submatrices and associate these with a weighted directed graph Q ; (ii) we show 
that the problem of evaluating any submatrix of /(M) is equivalent to summing the 
weights of all the walks that join a particular pair of vertices in this directed graph; 
(iii) we use a universal result about the structure of walks on graphs to exactly resum 
the weights of families of walks to infinite order. This reduces the sum over weighted 
walks to a sum over weighted paths, a path being forbidden to visit any vertex more 
than once. For any finite size matrix, the graph Q is finite and so is the number of 
path. We apply the method of path-sums to four common matrix functions: a matrix 
raised to an arbitrary complex power, the matrix inverse, the matrix exponential, 
and the matrix logarithm. In each case, we obtain an exact closed-form expression 
that allows the corresponding function /(M) to be analytically evaluated in a finite 
number of operations, provided M has a finite size. 
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This paper is organized as follows. In fJD we present the foundational material 
required by the method of path-sums: in ^2.1\ we describe the partition of a matrix 
into submatrices ; in ij2.3l we construct the graph corresponding to this partition, and 
describe the mapping between matrix multiplication and walks on the corresponding 
graph; in ^2.41 we present the closed-form expression for the sum of all the walks 
on a graph that underpins the method of path-sums. In Sj3l we present path-sum 
expressions for a matrix raised to a complex power, the matrix inverse, the matrix 
exponential, and the matrix logarithm. These results are proved in Appendix [X] In 
311 we provide examples of the application of our results. 

2. Required Concepts. In this section we present the three main concepts 
that underpin the method of path-sums. We begin by outlining the partition of an 
arbitrary matrix M into a collection of sub-arrays, and show how this partition leads 
naturally to the definition of a weighted directed graph Q that encodes the structure 
of M. We then show that computing any power of M is equivalent to evaluating the 
weights of a family of walks on Q. We conclude by presenting a universal result on 
the structure of walks on graphs that forms the basis for a closed-form summation of 
classes of walks on Q. 

2.1. Matrix partitions. A partition of a matrix M is a regrouping of the ele- 
ments of M into smaller arrays which interpolate between the usual matrix elements 
of M and M itself. In this section we show how these arrays can be used to compute 
any function that can be expressed as a power series in M. 

Definition 2.1 (General matrix partitions). Let M he a D x D matrix over the 
complex field C. Let 1^ be a Z?-dimensional vector space over C with orthonormal basis 
{vi} (1 < * < D), where we have adopted Dirac notation. Consider an ensemble of 
vector spaces Vi, . . . ,Vn such that Vi®V2©- • - 014 = V. Let Vj have dimension dj and 
basis {vi^ J.}, with 1 < k < dj and 1 < ij^k ^ D, and let Ej be the orthogonal projector 

onto Vj, i.e. ej ~ SfeLi ''^ij & "^Ij ^ where f designates the conjugate transposition. 
These projectors satisfy SiEj = Si,j et, and the closure relation J2^=i = ^ with I is 
the identity operator on V. Consider the restriction-operator e ^d^^xD ^ such that 
Rj'^R^ = where T designates the transposition. A general partition of the matrix 
M is then defined to be the ensemble of matrices {M^^} (1 < (/i, i') < n), where 

M^, -R^MRT (2.1) 

is a rf^ X d^ matrix that defines a linear map ip|^^^ '■ Vv ~^ y^i- For /i 7^ i^, we call 
M^u a fiip, while for ji = v, we call M^.^ — Mj^ a static. The projectors e^^ are called 
projector-lattices. In general there is no relationship between M^i, and M^^. However 
if M is Hermitian then M^,^ = Mj^,^ and Mi, = M^. Similar relations can be derived 
for the case where M is symmetric or antisymmetric. 

Remark 2.1 (Block matrix representation). For any general partition {M^jy} of 
M, there exists a permutation matrix P such that all M^jy are contiguous blocks in 
PMPT. 

Example 2.1 (General partition of a matrix). To illustrate a general partition, 
consider the 4x4 matrix M with elements (M)^^ — niij, which can be interpreted 
as a linear map on the vector space V = span(wi, W2, wa, W4) with vi = (1,0,0,0)"^, 
V2 — (0, 1, 0, 0)""", etc. Choosing vector spaces Vi = span(wi, 1)3, U4) and V2 ~ span(u2) 
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Fig. 2.1: The B4 = 15 possible partitions of a 4 x 4 matrix by diagonal projector- 
lattices. Solid and bicolor squares represent the matrix elements of statics and flips, 
respectively. The three tensor product partitions are framed. The trivial partition is 
in the upper-left corner, while the partition into the usual matrix elements is in the 
lower-right corner. 



such that Vi V2 = V, yields the following partition of M 

M21=(m21 77123 "124) 



■mil ™i3 

Mil = I "^31 "^33 
.77141 "^43 




M22=(r7722)(2.2) 



Remark 2.2 (Number of general partitions). The partition of a matrix M into 
flips and statics is not unique - any ensemble of vector spaces such that ®"=i Vj = 
V produces a valid partition of M. Consequently a D x D matrix admits S{D,n) 
partitions on n such vector spaces, where S{D, n) is the Stirling number of the second 
kind. It follows that the total number of general partitions of M is the D"^ Bell number 
Bjj = '^nS{D,n). Included in this number are the partition of M into the usual 
matrix elements (i.e. M^i, — [m^i,)) obtained by choosing {V^} to be D subspaces 
of dimension one, and the partition of M into a single static Mi — M, obtained by 
choosing Vi = V. In between these extremes, the subarrays M^^, interpolate between 
the normal matrix elements of M and the matrix M itself. Figure 12.11 illustrates the 
whole collection of possible repartitions of a 4 x 4 matrix into submatrices. 

Definition 2.2 (Tensor product partitions). An important subclass of matrix 
partitions are those that correspond to projector-lattices of tensor product form. This 
subclass of partitions will be referred to as tensor product partitions, and arises when 
the vector space V is decomposed as the tensor product (instead of the direct sum) of a 
collection of subspaces. Let F be a Z?-dimensional vector space over the complex field 
C, and consider an ensemble of vector spaces Vi , . . . , Vat such that Vi (g) • • • Vat = T^- 
Let Vi have dimension di (2 < di < D) and orthonormal basis {fJ-i} (1 < /i < di), and 
let Pp,- — fii^l be the orthogonal projector onto the subspace of Vi spanned by ^i. 
Then a projector-lattice of tensor product form is 



S-i 



TV 



AS) 



^ Pi ' 



(2.3) 



i=S+l 



where I^'^-' is the identity operator on Vs and = (/ii, . . . , iis-i, l^-s+i, ■ ■ ■ , A*Jv) is an 
{N — l)-dimensional multi-index denoting which orthogonal projectors are present in 
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Efj, . The projector-lattice e}, acts as a projector on each Vi {i 7^ S) while applying 
the identity operator to V5. For fixed S there are D/ds distinct projector-lattices, 
corresponding to the different choices of the projector indices fii. For any D x D 

(S) (S) (S) 

matrix M and pair of projector-lattices ' , el ' there exists a x matrix M^i^^ 
such that 

S-l N 

M = (g) Tjp,^ ® M ® (g) T^f,^ , (2.4) 

1=1 i=S+l 

where T/iiti = A^j^^i^ is a transition operator from Vi to fj,i in V^. The matrix m'^J defines 
a linear map on Vg. The ensemble of {D/dsY niatrices {M^'f.^} will be referred to as 
a tensor product partition of M on V^. The three possible tensor product partitions 
of M are illustrated by the framed images in Figure 12.11 

2.2. The partition of matrix powers and functions. Since the matrix ele- 
ments of M'' (fc G N* = N\{0}) arc generated from those of M through the rules of 
matrix multiplication, the partition of a matrix power can be expressed in terms of 
the partition of the original matrix. Here we present this relationship for the case of 
a general partition of M; the case of a tensor product partition is identical. The proof 
of these results is deferred to Appendix El The partition of M''' is given in terms of the 
partition of M by (M*-')^^ = E^fc,...,,,^ ' ' ' ^mm^mo^^ where a = Tyi, w = 'qu+i, 
and each of the sums runs over the n values that index the vector spaces of the general 
partition. It follows that the partition of a matrix function /(M) with power series 
expansion /(M) = ^^^^ fk is 

00 

/(^Lo^E/fc E M^^,...M,3,,M,,„. (2.5) 

This equation provides a method of computing individual submatrices of /(M) with- 
out evaluating the full result. In the next section, we map the infinite sum of Eq. (j2.5p 
into a sum over the contributions of walks on a weighted graph, thus allowing exact 
resummations of families of terms of Eq. (|2.5p by applying results from graph theory. 

2.3. The graph of a matrix partition. Given an arbitrary partition of a 
matrix M, we construct a weighted directed graph Q that encodes the structure of 
this partition. Terms that contribute to the matrix power M*"' are then in one-to-one 
correspondence with walks of length k onQ. The infinite sum over walks on Q involved 
in the evaluation of /(M) is then reduced into a sum over paths on Q. 

Definition 2.3 (Graph of a matrix partition). Let {M^^} be the partition of 
M formed by a particular set of n projector-lattices {e^}. Then the graph of this 
matrix partition is defined to be the weighted directed graph Q — (V,f ,w), where 
V = {Vfi} is a set of to < n vertices with the same labels as the projector-lattices, 
£ = {(t^/i) : 7^ 0} is a set of directed edges among these vertices, and w is an 
edge-weight function that assigns the submatrix to the loop (/^/i) and M^^ to the 
link (h'fi). From now on, G\{a, /3, . . .} denotes the graph obtained by deleting vertices 
Q!,/3, . . . from Q: and Qq represents the graph obtained by deleting all self- loops from 

g. 

Remark 2.3 (Graph minors). The various graphs that correspond to the different 
ways of partitioning a matrix M into an ensemble of submatrices are minors of the 
graph obtained by partitioning M into its usual matrix elements. Note, this implies 
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(a) 

Fig. 2.2: (a) The graph of the general partition of the 4x4 matrix in Eq. (|2.6p onto 
the vector spaces Vi, V2, V3 defined in the text. Each edge in the graph is labelled by 
its weight, (b) Two walks of length 4 from vertex 2 to vertex 1 in thick red (left) and 



(M4) 



M31M12M2 and Cbiue = M1M12 (M2) 



131V131 
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blue (right) lines. Their contributions Ciod = 
form two of the eight terms that sum up to 

that the number of minors obtained by merging vertice^ on a graph with D vertices 
is at most Bd, with this bound being reached by the complete graph. 

Example 2.2 (Graph of a matrix partition). Consider decomposing the 4x4 
matrix 



(2.6) 
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onto vector spaces Vi — span('i;i, W2), V2 — span(w3), V3 — span(w4) with 
(1, 0, 0, 0)""", V2 = (0, 1, 0, 0)"'', etc. The corresponding partition of M is 
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/ mil 
\m2i 
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(2.7a) 
(2.7b) 



and M21 = M32 = M3 = 0. Figure illustrates Q, together with two walks of length 
4 from vertex 2 to vertex 1 that contribute to (M'*)^^^- 

Definition 2.4 (Walks, paths and bare cycles). Consider the graph of a ma- 
trix partition. Then: 

Walk. A walk is a vertex-edge sequence, written left-to-right; e.g. (a) {ar]2) (772) •■ ■ ivt^) 
A walk that starts and finishes on the same vertex will be termed a closed walk. The 
set of all walks from a to w on ^ will be denoted by Wg-aui, and is generally infinite. 
Path. A path is a walk whose vertices are all distinct. The set of all paths from a to 
ui on Q will be denoted by Pg-^au>- If the graph Q is finite then Pg;tMj is finite. 
Bare cycle. A bare cycle is a closed walk that does not revisit any internal vertices, 
i.e. essentially a closed path. The set of all bare cycles off a vertex a on Q, denoted 
by Cg-a is finite when Q is finite. 

The graph Q provides a useful representation of a matrix partition: each vertex 
represents a vector space in the partition, while each edge represents a linear mapping 
between vector spaces. The graph Q is thus a quiver and the ensemble of vector 



^We allow vertex merging regardless of whether vertices share an edge or not. 
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spaces {V^} together with the ensemble of Unear maps {^Pfj,^} is a representation of 
this quiver. Further, the pattern of edges in Q encodes the structure of M: each 
loop (/i/i) represents a non-zero static, while each link (lyfi) represents a non-zero 
flip. The matrix M can therefore be said to be a ^/-structured matrix. Every walk 
on Q, e.g. w = {r]i){r]iri2) ■ ■ ■ i'r]k-iVk)iVk), is now in one-to-one correspondence with 
a product c{w) = M^^^j^^^ ■ ■ ■ M,,3,,2 M^^^j^ of submatrices. This matrix product is 
termed the contribution of the walk w and, being a product of matrices, is written 
right-to- left. This correspondence allows a matrix power to be expressed as a sum 
over contributions of walks on Q. Equation (|2.5p becomes 

oo 

/(MU^E/fc E (2.8) 

k=0 Wg.^^^k 

where Wg-au-k is the set of all walks of length k from a to a; on Q. 

2.4. The path-sum. We now state a universal graph theoretic result on the 
structure of the walks on any graph, which we obtain in |13j . This result reduces a 
sum of walk contributions, such as the one of Eq. (|2.8p . into a sum of weighted paths 
and bare cycles. 

Theorem 2.1 (Path-sum). The sum of the contributions of all the walks from 
a to LO on a graph Q is given by the path-sum 

E "^^^^ = E ^(^yQ\{a....,^i} '^^'^t • • • c(^'2)e\{„} c^2a c{a)'g , (2.9a) 

where c^u is the weight associated to the edge (vfJ-) and c(a)g is given by the sum over 
the bare cycles 



I E '^"A''" '^(^™)e\{a,...,Mm-i} ' ' ' c(A*2)g\{Q,} Cp 

. Cg,^ 



-\ -1 

, (2.9b) 



with I the identity. The quantity c(a)g can be seen as an effective vertex weight 
resulting from the dressing of vertex a by all the closed walks off a in Q. Remark 
that if 5 is a finite graph, there is only a finite number of paths and bare cycles 
and Equations ()2.9ap and (j2.9bp present finitely many terms. Note that by analytic 
continuation. Theorem 12 . II holds regardless of the norm of the walk contributions [13]. 



3. Path-Sum Expressions for Common Matrix Functions. In f}2]we showed 
that projector-lattices can be used to evaluate the partition of a matrix function /(M) , 
and further, that the resulting expression can be interpreted as a sum over walks on 
a directed graph Q (Eq. ()2.8p ). This mapping enables results from graph theory to 
be applied to the evaluation of matrix power series. In this section we exploit this 
connection by using Theorem 12.11 to resum, in closed form, certain families of terms 
in the power series for the partition of some common matrix functions. For each 
function we resum all terms in the power series that correspond to closed walks on Q, 
and thereby obtain a closed-form expression for the submatrices f{M)uja- Since this 
expression takes the form of a finite sum over paths on Q, we refer to it as a path-sum 
result. We present path-sum results for a matrix raised to a general complex power, 
the matrix inverse, matrix exponential, and matrix logarithm. The results are proved 
in Appendix 13 and examples illustrating their use are provided in 21 
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3.1. A matrix raised to a complex power. 

Theorem 3.1 (Path-sum result for a matrix raised to a complex power). 

be a non-nilpotent matrix, {M^^} be an arbitrary partition of M and 



■•DxD 



Let M 

g € C. Then the partition of M'' is given by 

(M«)^a = -Z H ^g\{o.,...,.,}M M^., ■ ■ ■ Fg\{„}h] M,,„ fg[a] }[n] 

where Q is the graph o/{(M — \)^v}, (■ is the length of the path, ana 



, (3.1a) 

n— — q— 1 



\z- 



^hr^^Q\{c 



-l}[t^m] ■ ■ ■ ^g\{a}[mV 



(3.1b) 



with m the length of the bare cycle. 

Here Z^^ {g{z)} [n] denotes the inverse unilateral Z-transform of g{z). The quantity 
Fq [a] is a matrix continued fraction which terminates at a finite depth if Q is finite. 
It is an effective weight associated to vertex a resulting from the dressing of a by all 
the closed walks off a on Q. If a has no neighbours in Q then fg[a] = [\z~^ — Mq]^^ 
counts the contributions of all loops on a. 

3.2. The matrix inverse. 

Theorem 3.2 (Path-sum result for the matrix inverse). Let M e C^^^ be 

an invertible matrix, and {M^^} be an arbitrary partition of M. Then as long as all 
of the required inverses exist, the partition of is given by the path-sum 



(M-i) 



•F, 



(3.2a) 



where Q is the graph o/ {(M — \)^v}, (■ is the length of the path, and 



^ati,„,^g\{a,...,ti^_^}[l^-n 



■Fe\{a}[Ai2]M^ 



, (3.2b) 



with m the length of the bare cycle. 

The quantity Fg [a] is a matrix continued fraction which terminates at a finite depth if 
Q is finite. It is an effective weight associated to vertex a resulting from the dressing 
of a by all the closed walks off a ox\Q. If a has no neighbours in Q then Fg [a] = M^^ 
counts the contributions of all loops on a. 

Remark 3.1 (Known inversion formulae) . Two known matrix inversion results can 
be straightforwardly recovered as special cases of Theorem l3.2l Firstly, by considering 
the complete directed graph on two vertices, we obtain the well-known block inversion 
formula 



A B 
C D 



(A-BD-iC)^' 
-D-iC(A- BD-^O 



-A-iB (D - CA-iB) 
(D-CA-iB)"' 



(3.3) 



Secondly, by applying Theorem 13.21 to the linear graph on N < D vertices (denoted 
here Cm), we obtain known continued fraction formulae for the inverse oi a D x D 
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block tridiagonal matrix [TTJ [ini H] . This follows from the observation that a. C^- 
structured matrix is, up to a permutation of its rows and columns, a block tridiagonal 
matrix. We provide a general formula for the exponential and inverse of arbitrary 
>Cjv-structured matrices in i j4.2l 

Remark 3.2 (Path-sum results via the Cauchy integral formula). A path-sum 
expression can be derived for any matrix function upon using Theorem 13.21 together 
with the Cauchy integral formula 

im^^ I f{z){z\-M)-Uz, (3.4) 
27ri /r 

where = —1, / is an holomorphic function on an open subset ?7 of C and F is a 
closed contour completely contained in U that encloses the eigenvalues of M. However, 
for certain matrix functions (including all four we consider in this section) a path- 
sum expression can be derived independently of the Cauchy integral formula by using 
Theorem 12.11 directly on the power series for the function. This method is the one 
we use to prove the results of this section (see Appendix \K\ and can be extended to 
matrices over division rings, as will be exposed elsewhere. 

3.3. The matrix exponential. 

Theorem 3.3 (Path-sum result for the matrix exponential). Let M G 

([^d-kD {M^ij} be an arbitrary partition of M, with Q the corresponding graph. 
Then for r G C the partition o/exp(TM) is given by the path-sum 

exp(TM)^Q = < ^ Fg\{a,...,iyi}[^^]Mu,ue---^g\{a}W2]Mt,^aFg[a]>{t) , (3.5a) 
where £ is the length of the path and 



fg [a] 



S\ - Mr 



"e\{c 



(3.5b) 



with m the length of the bare cycle. 

Here s is the Laplace variable conjugate to t, and £,^^{g{s)}{t) denotes the inverse 
Laplace transform of g{s). The quantity fg[a\ is a matrix continued fraction which 
terminates at a finite depth if Q is finite. It is an effective weight associated to vertex 
a resulting from the dressing of a by all the closed walks off a on Q. If a has no 
neighbours in Q then fg [a] = [si — Mq,]~^ counts the contributions of all loops off a. 

Lemma 3.4 (Walk-sum result for the matrix exponential). Let M e C^^^ and 
{M^iy} be an arbitrary partition ofM, with Q the corresponding graph. Then for t g C 
the partition o/exp(TM) is given by the walk-sum 



exp(TM)^„ = / Aim--- I dti exp[(t-t„)M^] 



• exp [{t2 - ii)M^,] M^,„ exp [iiM„] . (3.6) 



This result corresponds to dressing the vertices only by loops, instead of by all closed 
walks. An infinite sum over all walks from a to a; on the loopless graph therefore 
remains to be carried out. 
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(jj = a, 



3.4. The matrix logarithm. 

Theorem 3.5 (Path-sum result for the principal logarithm). Let M G 

i^DxD ^ matrix with no eigenvalues on the negative real axis, and {Mf^^} be a 
partition of M. Then as long as all of the required inverses exist, the partition of the 
principal matrix logarithm of M is given by the path-sum 

(logM)_= (3.7a) 

/ dxx-i (l-FeH), 
Jo 

.1 

V / da; (-a;)'^ ^ Fg\{„_..._^,}[a;]M<^i,, • • • Fg\{„}[j/2] M^^a Fg[a], w 7^ a, 

where Q is the graph of {(I — M)^j^}, t the length of the path and 

FeN= (3.7b) 

1 ~^ 

I - a;(l - M„) (-2:)" Ma^„^Fg\{„ ••• M^3^2Fg\{c<}[M2]M^2a 

with m the length of the bare cycle. 

The quantity fg [a] is a matrix continued fraction which terminates at a finite depth if 
Q is finite. It is an effective weight associated to vertex a resuhing from the dressing 
of a by all the closed walks off a on CJ. If a has no neighbours in Q then fg[a] = 
[I — a:(l — Ma)] counts the contributions of all loops off a. 

Remark 3.3 (Richter relation). The path-sum expression of Theorem 13.51 is es- 
sentially the well-known integral relation for the matrix logarithm [12l [Ml [7] 



/■I 

logM= / (M - l)[a;(M - I) + Ij^^dx, 
Jo 



(3.8) 



with a path-sum expression of the integrand. However, the proof of Theorem [33] that 
we present in IA.5I does not make explicit use of Eq. (I3.8P . 



4. Examples. In this section we present some examples of the application of 
the path-sum method. In the first section we provide simple numerical examples for 
a matrix raised to a complex power, the matrix inverse, exponential, and logarithm. 
In the second part, we provide exact results for the matrix exponential and matrix 
inverse of block tridiagonal matrices and evaluate the computational cost of path-sum 
on arbitrary tree-structured matrices. 

4.1. Short examples. Example 4.1 (Singular defective matrix raised to an 
arbitrary complex power). To illustrate the result of Theorem l3.1[ we consider raising 
the matrix 

/-4 0-10 -l\ 
-2 -2 6-2 4 
M = 6 2 1 -2 3, (4.1) 
0-1-4 -1 
\-6 -2 -5 2 -7/ 
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to an arbitrary complex power q. Note that M is both singular and defective; i.e. non- 
diagonalizable. We partition M onto vector space Vi = span(wi,U2) and V2 = 
span(t;3, V4, V5) with vi — (1, 0, 0, O)'^ etc., such that Vi ® V2 = V. The corresponding 
graph Q is the complete linear graph on two vertices, denoted IC2- Following Theorem 
13.11 the elements of M'^ are given by. 



and (M«)„- = -Z-i{F,cAjHMi2F^Jj]}[r 

71— — q— 1 



, (4.2) 

n—~q— 1 



where = 1,2, i =^ j, F^Ji] = [iz^^ - M 

\\z~^ — Mj] . We thus find in the Z-domain 



MyFK,\,[j]M,,] and F^,\,[j] 



M(z) = z{Az+l)-'^y. 



( 4z + l 
2z(4z- 1) 
2z(4z + 3) 


\-2z(4z + 3) 





+6z + 1 
2z(4z+ 1) 


-2z(4z+ 1) 



88z"'+50z"'+6z 

88z^+54z'' + 13z+l 
4z+l 

—z 

88z-^+38z^+5z 
4z + l 





-2z(4z+ 1) 
-2z(4z+ 1) 

4z+ 1 
2z(4z+ 1) 



(4.3) 



56z-'+34z^+4z 

4z + l 
56z^+22z''+3z 

4z + l 
— Z 

-56z-''-6z''+5z + l 
4z + l 



and finally M« = -Z-i{M(z)}[n]|„=_^_i, which is 







/ 8 







2q 







2q \ 








Sg- 


4 


4 


9(9-2) -11 


4 


q{q- 


- 2) - 7 




M« = i(i/2)^ 




-89- 


-4 


-4 


-q{q-2)-i 


4 




- 2) - 7 
















2q 


8 




2<Z 










4 


4 


q{q- 2) + 11 


-4 


q{q- 


-2) + 15y 




This expression 


is valid for 


any g e 


C and fulfills 




= M«M9', V(g,(j 


Setting q = 1/2, 


we obtain 






















/ 32 


4 















i 





16 -47 


16 


-31 






Ml/2 ^ _ 


-32 


-16 -9 


16 


-25 










16 





4 


32 


4 












32 


16 41 


-16 


57; 





(4.4) 



(4.5) 



with — —1, for which it is easily verified that (Mi/^)^ — M. Any p*^ root of M, 
with p G N* , can also be calculated and verified. Further, we note that although M 
is not invertible, setting g = — 1 in Eq. (|4.4p yields the Drazin inverse M-^ of M [3], 
while setting q = yields a left and right identity M'' on M 



1 

16 



/-4 





1 





1\ 


6 


-2 


4 


-2 


2 


-2 


2 


3 


-2 


5 








1 


-4 


1 


V2 


-2 


-7 


2 


-V 
















-4 


4 


-11 


4 


-7 


-4 


-4 


-3 


4 


-7 











8 





V4 


4 


11 


-4 


15/ 



The above Drazin inverse satisfies indeed MM^M = 
M9M° = M9~i. We also have M: M^M"? = M^M^ 



(4.6) 

, M^MMD = and U^W = 
M'' for any g G C and finally 
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M^M = MM° = as expected of the Drazin inverse. These properties imply that 
is the projector onto im(M), the image of M. 

In addition to the examples with q — —1, 0, and 1/p with p e N* presented 
here, the formula of Eq. (I4.4p also holds for any complex value of q and is well be- 
haved. For example, we verify analytically using Theorem 13.11 to calculate (M^')'^ 
that (M^')T' = M. Finally, it is noteworthy that numerical methods implemented by 
standard softwares such as MATLAB and Mathematica suffer from serious stability 
problems for the matrix considered here and return incorrect results, as can be seen 
for the case of g = 1/2. 

Example 4.2 (Matrix with a non-solvable characteristic polynomial raised to an 
arbitrary complex power) . Consider raising the matrix 



M 














-l/2\ 





2 


5/2 


2 


-1 


-4 











-1 





-1 





-2 


7/4 


Vo 


1 


2 





1 / 



(4.7) 



to an arbitrary complex power. The characteristic polynomial of M is xi^) = 

whose Galois group is the symmetric group 6*5 and is thus non-solvable. Proceeding 

similarly to the example 14.11 we obtain in the Z-domain 



/-ziz+l){ziz + 2) - 1) - 1 



M(z) = 



z-^ + 



lz'^izi2z + 5) + A) 
iz(z + l)2(4z-5) 

^{z^ {-z^ + z + i)-2) 
-iz2(z-f l)(15z-f 8) 

-^z{z + l){z{2z + 5) + 'i) 



2z^ (-4z2 + z + 5) (z - l)(2z + 1) (2z2 + z + l) 
2z(z((z-2)z-2) + 2) -2z^ + z^ + z^ 

iz3(15z + 8) -iz(z(z(8z + 3) + 7)-4) 

2z2(z(2z-f 5) +4) -z(z-|- l)(2z+ 1) 

(4.8) 

z3 i (z - 2z3) \ 

2(z-l)z(2z2 + z + l) -5z'' + z^ + 2z2 + z 

-2(z-l)z3 (z-l)z(2z2-l) 
i (z (z (-3z2 + z - 4) + 4) - 2) iz (lOz^ + 3z - 7) 

-2z2(z + l) (z + l)(2z2-l) J 



and = —Z ^{M{z)}[n\\n=-q-i- Performing the inverse-Z transform is straight- 
forward and yields M"? = J2k=i ^kil), with Rk{q) a matrix given by 



R;.('7) = 



P{rk) 



( ^fe - ^fe + ^fe + 3rfe + 1 
-2(rfe + l)(5rfc-4) 
-2(2r3.-2r2-2rfe + l) 
i(-8rfc-15) 
-2 (4r2 + 5rfe + 2) 
1 (_4,2 _ 5^^ _ 2) 
i(rfc-Kl)2(5rfe-4) -2rfe 



V 



i(rfc + l)(2r3-2r2-2rfe4 
i(rfe + l)(8rfc + 15) 
i(rfc-Hl)(4r2+5rfc + 2) 



1 



-irfe(rfc -F2) 
(rfc -l)(rfe + 2) (r2. +rfe + 2) 
(l-r-fe)(rfc-f2) 
i(-4r3 + 7r2+3rfe + 8) 



(4.9) 



-2(rfc- 1) 



■Art 



2rk{rk + l) 



-\rk {rl-2 
-4 - '2rl - Tk 



{^-rk){rl- 
Tkirk + 1) [r] 



+ 5 

10) 

-2). 



where Vk is the fcth root of x{^) and P{rk) — Y[^=i i^k^^k — Using the analytical 
properties of the roots of x(a;), we verify that the above formula yields the correct 
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integer-powers, inverse and pth-roots (p e N* ) of M . 

Example 4.3 (Matrix inverse). To illustrate the application of Theorem 13.21 we 
compute the inverse of the matrix of Eq. (|4.7|) . We partition M onto vector spaces 
Vi = span(i;i), V2 = span(t;3,U5) and V3 = span(w2,«4), giving 



(-1)^ - ^o 1 
I12 = (0 -1/2) , M21 = 







M, 



123 



2 2 

-1 -2 



1 



132 = 



5/2 -r 

7/4/' 



(4.10) 
(4.11) 



and M13 = M31 = 0. The corresponding graph is thus the linear graph on three 
vertices, denoted by £3. By Theorem l3.21 the diagonal elements of M"-'^ are given by 



while the off-diagonal elements are 

(M"')2i = -F£3\{i}[2]M2iF^3[l], (M-i)^2 
(M"')32--F^3\{2}[3]M32F^3[2], (M-i)23 
(M-i)3^ = F£3\{i^2}[3] M32 F£3\{i}[2] M21 fcsin, 
(M-i)^3 = F£3\{3,2}[1] M12 F£3\{3}[2] M23 fcsm. 



'33 



(4.12a) 



-F,:3\{2}[l]Mi2F£3[2], (4.12b) 
T£3\{3}[2]M23F£3[3], (4.12c) 
(4.12d) 
(4.12e) 



The matrices fg[a] are evaluated according to the recursive definition in Eq. (|3.2b|) : 
for example 



F£3[l]=[Mi-Mi2F£3\{i}[2]M2i 



Mi2[M2 - M23F£3\{i,2}[3]M 



32J 



= [Ml - Mi2[M2 - M23M^iM32]"'M2i] (4.13) 
Evaluating the flips and statics and reassembling them into matrix form gives 



(4.14) 



which is readily verified to be the inverse of M and is identical to the evaluation of 
M ^ ^ as found in example 14.21 using Theorem 13.11 

Example 4.4 (Matrix exponential). As an example of the application of Theorem 
and Lemma 13.41 we consider the matrix exponential of 



/ 8 





-4 





^ 


64 


-32 


-16 


-32 


40 


-16 


16 


4 


16 


-16 


-60 


16 


15 


12 


-20 


\-32 





8 





) 










-i 0\ 


M = 





2 - i 


-1/3 







-i 




1 3 


-7/2 


1 -1/ 


We use a tensor product partition 







(4.15) 



'1-i 
2- i 



M, 



-i 
-1/3 



M21 



^ 

'7/2. 
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Since every element of this matrix partition is non-zero, the corresponding graph is 
JC2- Let us focus on the element exp(M)ii, which forms the top-left corner of the full 
matrix exp(M). By Theorem 13.31 the exact result for exp(iM)ii is given by 



( 

s2-(l-2i)s-(2 + i) 

-i 1 
V3s3 _ (9 _ 9|)s2 _ (g 4^ i8|)s 4. 15 s-{2-\)j 

The inverse Laplace transform can be carried out analytically; setting t 
result gives 



,(l-2i)/2 

15 



3 (^5cosh^ -|-y5sinh^ 




2.05220- 3.19611 i 
-0.442190 - 0.283927 i 3.99232 - 6.21768 i 



(4.16a) 
(4.16b) 
1 in the 

(4.17a) 
(4.17b) 



Alternatively, we can evaluate this element by using a walk-sum, as presented in 
Lemma 13.41 



1 





t2 



e(i-*=)^i M12 e(*^-*i)^= M21 e*i^^ dt^ dt2 



(4.18) 



e(i-t4)MiM^^g(t4-t3)M. M2ie(*^-*^)^i Mi2e(*^-*i)^^ 

Evaluating these terms yields 

IM\ ^ ( 2.05083- 3.19398 i 
l<5 '11 - 1 -0.441354- 0.2833901 3.99232 - 6.21768 i 



l2ic*^'^Mii---dt4 



(4.19) 



Although this result has been obtained by evaluating only the first three terms of 
an infinite series, it is already an excellent approximation to the exact answer: the 
maximum absolute elementwise error is ~ 2.5 x 10"^. This rapid convergence results 
from the exact resummation of the terms in the original Taylor series that correspond 
to walks on the graph IC2 that contain loops. 

Example 4.5 (Matrix logarithm of a defective matrix). We compute the principal 
logarithm of the matrix 



(4.20) 



This matrix has only one eigenvector associated to the fifth-fold degenerate eigenvalue 





1 


1 


2 


-1\ 


-2 


7 


1 





-1 





-1 


5 


2 


1 


-2 








8 





V-2 


-4 


-4 


6 





6. Note also that 11 Ml 



12, with 



the operator norm. We choose to partition 



M onto vector spaces Vi = span(?;i, U3, U4) and V2 = span(w2, ^5). The corresponding 
graph Q is the complete directed graph on two vertices K,2- Following Theorem 13.51 
we have 



b-]M,,] \ and Fyc,\4i] = [l-^(l-M,,)] \ (4.21) 
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where — 1,2, i ^ j and I is the identity matrix of appropriate dimension. Then 
the matrix elements of the principal logarithm of M are given by 

(logM)^^= f'x-^l-f^Mdx, (logM) =-/'F;c.v[j]M,.F^,Wdx. (4.22) 
Jo Jo 

Reassembling them in a matrix, we obtain 



log M = I log 6 + 



324 



/- 


-108 


41 


41 


130 


-63\ 




-126 


42 


42 


41 


-65 




18 


-37 


-37 


71 


56 




-108 


5 


5 


112 


-9 


V 


-108 


-211 


-211 


328 


-V 



(4.23) 



Example 4.6 (Matrix exponential of a quaternionic matrix). The graph-theoretic 
nature of Theorem 12.11 allows the method to be extended to matrices over non- 
commutative division rings B. In particular, we will show that Theorems 13.1113.51 
hold for quaternionic matrices M e H^^^ as well. For example, consider calculating 
exp(7rM) with M the quaternionic matrix 



(4.24) 



where i, j, and k are the quaternions, which satisfy i^ = =k^ = ijk = —1. Following 
Theorem [331 '^^ find for example the matrix element Mn to be in the Laplace domain 



/:[exp(iM)n] - (5-i-j(s-l)-ik)- 



(4.25) 



Calculating the other matrix elements, inverting the Laplace transforms and setting 
t = TT, we obtain 



exp(7rh 



1 



tanh (I) 
k-j 



j-k 
tanh ( 



(4.26) 



4.2. Exact matrix exponential of block tridiagonal matrices. Let {Mk',k} 
be a partition of a matrix M such that Mk':^k±i.k — 0. If this partition consists of 
N'^ pieces, the corresponding graph is the finite linear graph Cn, and M can therefore 
be said to be an >Cjv-structured matrix. As mentioned in remarks 12.11 and 13.11 such a 
matrix is essentially a block tridiagonal matrix since there exists a permutation matrix 
P such that PMP"^ is block tridiagonal. For these matrices, the path-sum expression 
for the matrix exponential and inverse can be written in a particularly compact form. 
For fc = 1, . . . , A^, we set = si — M^, and define the finite continued fractions 



Mi 



'k,k- 



Ifc-l.fc 



(4.27) 



with Xjv = M^r^ and Yi = ^ Note that the inversion height of ( Y^ ) is iV -f- 1 - fc 
(fc). Let U = £[exp(i M)] be the Laplace transform of the matrix exponential of M; 
then the partition of U is given by 



Ufcfc — 



fc 

Ufc,fc'<fc = Y\_ 



Ufc' 



k'k' 



(4.28a) 
(4.28b) 
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where rij=i ~ ^Jn^n-i ■ ■ ■ 0201 is a left product. Provided the required inverse 
Laplace-transforms are analytically available, Eq. (14 .2 7114 .281^ yields the exact matrix 
exponential of M. Similar formulae for the inverse of arbitrary £Ar-structured matrices 
are obtained upon replacing si by I in each of the M^. 

4.3. Computational cost of path-sum on arbitrary tree-structured ma- 
trices. The number of paths in any finite graph is finite. Thus, as soon as a matrix M 
has a finite size, the path-sum expressions of Theorems 13.1113.51 evaluate any function 
/(M) exactly in a finite number p of operations. In this final example we calculate p 
in the case of matrices M whose partition is an arbitrary tree, denoted by T/v- 

First, we consider the computational cost of evaluating a static /(M)^^. Since a 
tree contains no bare cycles of length greater than 2, the vertex a requires dressing only 
by loops and edge cycles on T/v- Consequently, the sequence of operations involved 
in dressing a fall into two categories: nesting (adding an edge cycle which dresses the 
internal vertex of a previous edge cycle) or branching (including an extra edge cycle at 
constant dressing depth). These two operations have the same computational cost, as 
each requires one inversion, two multiplications and one subtraction of d x d matrices. 
Due to this symmetry between branching and nesting, the computational costs of 
dressing a vertex on the linear graph on N vertices Cn (which involves nesting only) 
and the star graph on N vertices Sn (which involves branching only) are identical: 
each requires N inversions, 2{N— 1) multiplications and TV — 1 additions to fully dress 
any vertex. Since any tree can be decomposed as an ensemble of linear graphs (the 
branches) and star graphs (the nodes), the computational cost of evaluating f{M)aa 
when M is tree-structured depends only on the number of vertices of the tree: the cost 
is independent of the detailed structure of Tn- The number of floating point operations 
required to evaluate the diagonal element f{M)aa, denoted by pTiv;a, scales as 3Nd^, 
while the computational density (the number of operations per usual matrix-element 
evaluated) is ~ 3Nd. 

We now consider the cost of calculating an off-diagonal element f{M)^a- Let 
{ai'2 • • • i^i^) be the unique path leading from a to w on Tzv, and ptn-.u be the cost of 
fully dressing the vertex a on T/v- Then the total cost of evaluating f{M)uja is 

i>+i 

2£d3 + ^pr«\{a,...,..-i};.., (4-29) 
i=l 

where the first term accounts for the cost of evaluating the matrix multiplications 
along the path. Note that this cost depends on the structure of T/v, since the number 
of vertices in each tree in the sequence T/v\{q^, - - - , depends on whether any of 

the previously- visited vertices are nodes of T/v- Nevertheless, we can place an upper 
bound on the cost by considering the case where the tree T/v is the linear graph Cn- 
Then £/v\{a, - - - , i^i-i} contains N + 1 — i vertices, and the total cost of evaluating 
the contribution of a path of length ^ is ~ £cfi{3N + 2). Finally, we note that in the 
course of evaluating the contribution of a certain path p, we simultaneously evaluate 
the contributions of all subpaths of p. The operations counted by Eq. (|4.29|) therefore 
generate {£+l)cP elements of the partition of /(M). This improves the computational 
density of the path-sum method for tree-structured matrices to ^ 3iVc?. Therefore, 
we conclude that evaluating any element of a partition of a matrix function of a tree- 
structured matrix using path-sums is efficient: i.e. the cost is linear in the number of 
vertices in the tree. 

Example 4.7 (Vertex dressing on a tree). To illustrate the above discussion, 
consider the cost of calculating the inverse of a matrix M e C^^^^^^'', d &N* whose 
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Fig. 4.1: A tree on = 5 vertices. All edges are bidirectional. 

tensor-product partition into dx d blocks yields the tree on A^ = 5 vertices represented 
on Fig. 14.11 Let M^^ be the submatrix associated to the edge (vii) on the graph. 
Now consider calculating (M~-'^)3. According to Theorem l3.2[ it is 

branching branching branching 

(M-l)3= [M3 - M32[M2 - M2lMr'Mi2]-lM23-'M34MjlM43-'M35M'^lM53'"' 



nesting 

This comprises three branching operations corresponding to the three branches at- 
tached to vertex (3) and one nesting corresponding to the dressing of vertex (2) by 
cycles through (1). In total (M^^)3 thus requires 5 inversions, 8 multiplications and 
3 additions oi d x d matrices, that is (5 + 8)d'^ + 3d^ operations which scales as 3d^N 
as expected. Now consider calculating (M^^)i. Following Theorem l3.2l we find 

(M-l)i = Ml - Mi2[M2 - M23[M3 - M34M4IM43 - M35M-iM53]-iM32]"^M2i 

This comprises two successive nesting operations corresponding to the dressing of 
vertex (1) by cycles through (2) and (2) by cycles through (3) and two branching 
operations corresponding to remaining branches off (3). In total (M^^)i thus requires 
5 inversions, 8 multiplications and 3 additions oi dxd matrices exactly like (M~-'^)3, as 
expected. The computational cost of calculating any element of M', exp(M) or log(M) 
is identical, except for the additional costs associated to the inverse Z-transform, 
Laplace-transform and Richtcr integral, respectively. 

5. Conclusion and Outlook. The method of path-sums is based on three main 
concepts: firstly, the partitioning of a discrete matrix M into an ensemble of subma- 
trices whose dimensionalities can be freely chosen; secondly, the mapping between 
multiplication of M and walks on a graph Q whose edge pattern encodes the structure 
of M ; and thirdly, the exact closed-form resummation of certain classes of walks on Q 
through the dressing of vertices by cycles. By combining these concepts, any partition 
of a function of a finite matrix f(M) can be exactly evaluated in a finite number of 
steps, provided the required inverse transforms are analytically available. The graph- 
theoretic nature of Theorem 12 . 1 1 permits the extension of the method of path-sums to 
functions of continuous operators as well as matrices with entries in non-commutative 
division rings; as we will show elsewhere. 

Using a directed graph to encode the structure of a matrix allows any structure 
and symmetries that the matrix possesses to be easily recognized and exploited. We 
thus expect the method of path-sums to have widespread applications in, for example, 
the study of Markov chains and quantum many-body physics, where the relevant 
matrix - the many-body Hamiltonian - is both sparse and highly structured. We 
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have already successfully implemented the method to study the dynamics of Rydberg- 
excited Mott insulators [B; . We also note that a generalization of the walk-sum result 
for the matrix exponential to continuous matrices is already known, and leads to 
Feynman path integrals, while the cycle dressing of a vertex yields the Dyson equation; 
these results will be presented elsewhere. We expect that this approach to path 
integrals will help understand their divergences. 

Finally, the development and study of numerical implementations of the path-sum 
method is a topic of key importance for future work. Indeed for most applications 
requiring the computation of a function of a matrix, an inexact but accurate result 
is sufficient, in particular if the matrix M itself is known only with a finite precision. 
Additionally on highly connected graphs the number of paths and bare cycles can be 
very large, so that an exact evaluation of the flips and statics of /(M) may have a 
prohibitive computational cost. In these cases, it is desirable to truncate the exact 
expressions given in Theorems 13.1113.51 e.g. by dressing vertices to a depth smaller 
than their maximum dressing depth or by neglecting certain paths. This may also be 
motivated by considerations external to the method: in quantum mechanics, paths 
and cycles on the graph of the Hamiltonian represent physical processes (similarly to 
Feynman diagrams) some of which might be negligible. The accuracy of truncated 
numerical approximations to the path-sum will thus be of paramount importance in 
many applications. Recent research [1] [2l IS [5l [8] has shown that the entries /(M)^_^. 
of certain matrix functions decay exponentially with the length of the shortest path 
between the vertices that correspond to entries Ma and Mjj. If these results can be 
extended to the norm of the statics and flips of a general partition of /(M) , they could 
be used to estimate the contribution of each path in a path-sum expression, thereby 
giving some indication of how the truncation of a path-sum expression would affect 
the accuracy of the result. 

Acknowledgments. Wc thank M. Benzi for fruitful discussions. 

Appendix. Proofs of Path-Sum Expressions for Common Matrix Func- 
tions. In this appendix we prove the path-sum results presented earlier without proof. 
We begin by proving the results of ! j2. 21 relating the partitions of M'' and /(M) to the 
partition of M. We then prove Theorems l3.Hl375l i.e. the path-sum results for a matrix 
raised to a complex power fi jA.2[l . the matrix inverse ( ^A.3[) . the matrix exponential 
( §A.4p . and the matrix logarithm (i jA.Sp . 

A.l. Partitions of matrix powers and functions. Consider an element R^^M'^R^ 
of a general partition of M'^. On inserting the identity in the form of the closure re- 
lation over projector-lattices between each appearance of M in the product and using 
— Rj^Rf^, we obtain 

(M').„-E R-MRTr^^...MR^^R^^MRT= ^ M^,,...M,3,,M,,„, (A.l) 

Ik, ■■■,12 ri^,...,ri2 

with a = rji and cj = ijk+i- This expression describes matrix multiplication in terms of 
the partition of M and provides an explicit description of which pieces of M contribute 
to a given piece of M*^. It follows that the partition of a matrix function /(M) with 
power series /(M) '^kLo fk^^ is given by 

oo 

/(M).„ = E^- E M...---M,3..M,,„. (A.2) 
This equation relates the partition of /(M) to that of M. 
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A. 2. A matrix raised to a complex power. Proof. We consider a matrix 
M G C''^^''^. To prove Theorem 13. II we start from the power series 

M' = E(fcj(M-l)', (A.3) 

where q £ C and (^) = q—/k\ is a binomial coefficient, with q— the falling factorial. 
Note that although the sum only converges when ||M — l|| < 1, with ||.|| a sub- 
multiplicative norm, the result of Theorem 13. II is valid for matrices of arbitrary norm 
by analytic continuation. By applying the result of Eq. p.5[) to Eq. (jA.Sp we find that 
an element of a partition of M' is given by 

(M')..-E(fc) E M^..---M,3,,M,,„, (A.4) 

fc=0 ^ ^ Ws;ca,;fc 

where we have introduced the auxiliary matrix M = M — I and Q is the graph of the 
partition of M. We shall now recast this expression so as to make the loops of the 
walk (a) (0772) • ■ ■ (?yfc'j-')((u;) appear explicitly. To this end, we remark that when a loop 
off a vertex fi occurs p e N consecutive times in a walk, the contribution of the walk 
is comprises a factor of (M^)p. Thus 

(M').o = Eu)E E E (M.)^'"+^M„„„...(M^,rM,,„(M„r- (A.5) 

fe=0^ m=OWgo,^^■,rr^ {pi}/k-m 

In this expression any two consecutive vertices fj,e and fie+i arc now distinct and the 
sum X^Wg m '"^^ walks of the loopless graph Qq. Each integer £ N, 

called a loop number, represents the number of consecutive times a loop is undergone 
off a certain vertex. The notation {pi}/k — m on the final sum therefore indicates 
that the final sum runs over all possible configurations of the pi numbers, that is all 
configurations oik — m loops on m-l- 1 vertices, subject to the restriction that the loop 
number pi on any loopless vertex is fixed to zero. This implies that X^i^Ti^ Pi = k — m 
and the Pi are thus said to form a weak composition of A; — m. We now remark that 
for any such weak composition and g € C, the following relation holds: 

(fc)=E E •••ET^^(-ir-((-'^-i)-^"^+^'™+0^--- 

■ ■ ■ (-ir(fc2 - fci +P2)pi {-i)p^{ki+p,)p^, (A.6) 

where the first sum is an indefinite sum to be evaluated at km — —q— 1. From now 
on we will denote this by J2k '=o- Equation (jA.6p . which is independent of the value 
of each individual pi, is proved by induction on m. Upon substituting this relation 
into Eq. (jA.3|) and rearranging the order of the summations we obtain 

00 00 — q— 1 kjj^ k2 

(M^)..=E(-i)"E E E E •••E(-M.)--((-?-i)-fc™+p™+i)^ 

m=0 Wg(,;cu;m{pi}=0 fem=0 fe„_i=0 fci=0 

• • • (-M^,r(fc2 - fci +P2)£^M^,„(M„r(fci +pi)£^, (A.7) 

where the sum }=o ~ X]^=o ' ' ' +1=0 '"uns over all the loop numbers, subject 
to the restriction that the loop number pi on any loopless vertex is fixed to zero. We 
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now evaluate the contributions from the infinite loop sums in closed form by noting 
that 



-(fci-fci_l)-l 



(Ai 



Pi=0 



where we have used the fact that 



III < 



I II < 1. Introducing 



Eq. (|A.8|) into Eq. (|A.7|) and setting fcg = by definition yields the expression 



-q-l k„ 



.. = EMr E E E •••E(M.)- 



((-9-i)-fc„)-ir 



m=0 W'gQiai^;™ fc„,=0 fc,„_i=0 fci=0 



(A.9) 



This expression is an m-fold nested discrete convolution. In order to convert the 
discrete convolution to a product, we take the unilateral Z-transform of the above 
expression with respect to n = — g — 1. We obtain 



71— — q— 1 



(A.IO) 



where z G C is the Z-domain variable. Now the content of the inverse Z-transform is 
a sum of walk contributions. Indeed we can see c^^ = [\z~^ — M„] as an effective 
weight associated to vertex a. This effective weight results from the dressing of a by 
all the loops off a which is performed by Eq. (jA.8[) . Then upon remarking that e.g. 
M/i2Q — Cfi2a is the weight associated to edge (a/i2) from a to /i2, Eq. (|A.10|) is 



off ^cff\r 1 

f_i2 C/J2a f ["-J 



n——q— 1 

This is now in a form suitable to the use of Theorem 12.11 We obtain 

(M«)^„ = Z^l E [w] M^^, • • • Fg\{„} [V2] M^,„ fg [a] \ [n] 

where G is the graph oi {{M — \) ^i,} , £ is the length of the path, and 

fg[a] = MQ/^™Fe\{a,...,M„-i}[Mm] ' ' ' Fg\{a} [/i2] M^^^ 



(A.ll) 



(A.12) 

n——q—l 



(A.13) 



with m the length of the bare cycle. The quantity fg [a] can itself be seen as an 
effective weight associated to vertex a resulting from the dressing of a by all the 
closed walks off a in C/. Since a loop is a bare cycle, the dressing of the vertices 
by their loops is included in fg [a] as well. This is obvious if one considers a graph 
Q that is reduced to a unique vertex a presenting a loop. In that case Eq. (IA.13P 
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yields Fc[q;] — [\z ^ — M^^] ^ = c"^. For convenience we can make the loop dressing 
completely explicit in Eq. (jA.13l) by separating the loops from the other bare cycles 

fg[a]^ Iz"^ - Ma - ^ Ma^^Fgy{c.,...,M„.-l}[Mm] • • ■ Fg\{a}[^2]M^,a , (A.14) 

and note that now the sum runs over the bare cycles of the loopless graph Qo . Together 
with Eq. (|XT2)) the above Eq. (|XT4| proves Theorem 13. II □ 

A. 3. The matrix inverse. Proof. We consider an invertible matrix M e C'^^^. 
To prove Theorem 13.21 we write the matrix inverse as = J2^=o (' ~ M)". Note 
that the sum only converges for ||l — M|| < 1; nevertheless, the end result can be 
extended to matrices of arbitrary norm by analytic continuation, and Theorem 13.21 is 
therefore valid for all matrices, regardless of norm. Introducing an auxiliary matrix 
M = I — M , we apply the result of Eq. (|2.5p to the power series to obtain 



(M"')^„ = E E M^,„---M,3,,M,,„. (A.15) 

n=0 Wg-coj-.n 

where Q is the graph of the partition of M . We follow the same procedure as in ^A.2I 
above and we omit the details; the result is 

oo 

n=0 Wg^y.^^-^ 
oo 

= E E (-i)"m-im^,„...m;/m,,„m-\ (A.16b) 

where we have used ~ I — and M^i, — — M^^. Eq. ()A.16bp is a sum of walk 
contributions with effective vertex weights c^^ I'^sulting from the loop dressing 

of jjL which occurs when ^ 0. We now use Theorem 12.11 and obtain 

(M"')„„= E (-l)'Fe\{a,...,.aHM<.., •••Fg\{,}[i.2]M,,„Fe[a], (A.17a) 

where Q is the graph of {(M — 1)^,^}, £ is the length of the path, and 
Fe[a] = [M„- E (~l)"''^"'^"'^e\{a,...,M„.-i}[A'm]---Fe\{a}[Ai2]M^,c«] ! (A.17b) 

with m the length of the bare cycle. Similarly to ^K.2\ we have separated the con- 
tribution of the loops from that of the other bare cycles. This proves Theorem 13.21 
□ 

A. 4. The matrix exponential. Proof. We consider a matrix M G C''^^'''. 
To prove Theorem 13.31 and Lemma 13. 4[ we start from the power series expression 
exp(i M) = X]^o '•"'^'V'^'- By applying the result of Eq. (|2.5p to this series we find 
that the partition of exp(t M) is given by 

exp(tM)^„ = E— E M,^^,. •••M^3^,M^,„. (A.18) 

n=0 Wg-au^.r, 
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with Q the graph of the partition of M . Following the same procedure as in we 
make the loop of the walks appear explicitly 

oo n 

exp(iMU=^-^ J2 ^ (MJ^"+^M„^„...(M^,rM^,„(M„f; (A.19) 

n=Q ' m=QWgQ.auj:m {pi}/n—m 

where the again loop numbers satisfy X^ta^ Pi = n. — m, with the restriction that the 
loop numbers on any loopless vertices are fixed to zero. Such a sequence is said to 
form a weak composition of n — m. We now note that for any weak composition of 
n — m, the following identity holds: 

1 rti j.n 

/ di„ • • • / dh{t- t„,r"^+' ■■■{t2- tif- = -. (A.20) 

This result - which does not depend on the value of each individual pi - is straight- 
forwardly proved by induction on m. By substituting this identity into Eq. (|A.19p 
and rearranging the order of summations we obtain 

exp(*M)^„= (A.21a) 

m=0 Wgj,.„^^.„ {pi}=0 



pi 



Jo Pm+l'- P2'- Pi'- 



= E E /dt„.---/ diie^'-'-^^-M^^^.-.e^'-'^'^-M^.^e*^^". (A.21b) 

This intermediate result proves Lemma 13.41 In order to continue, we note that this 
expression is an m-fold nested convolution. To convert the convolution to a product 
we take the Laplace transform of both sides: 

oo 

£[exp(tMU] = ^ ^ M^^„...£[^,(t)] M^,„£[/„(t)], (A.22) 

oo 

= E E - M^r' M^^„ • • • [si - M^J-i U^,^ [si - M„]-i , (A.23) 

m=0 We(,,Qi^;m 

where the second line follows on noting the result £[exp(tM^)] = [si — M^] ^. As 
in the previous sections, we remark that Eq. (|A.23p is a sum of walk contributions 
with an effective vertex weig ht oicf = [si - M,J"\ On using Theorem 12.11 to turn 
Eq. (|A.23p into a path-sum, we obtain 

^max 

£[exp(iM)^J = 2 E Fe\{a,...,.,}HM^.. ••• Fg\{„}[z/2]M,,„Fe[a], (A.24a) 



Fg[a] = S\-Ma- ^ Ma^,^^Q\{a,...,^_l^_l}[^lm]■■■^g\{a}[^^2\M^,2a , (A.24b) 

where i and m are the length of the path and of the bare cycle, respectively. In this 
expression, the contribution from the loops is explicitly separated from that of the 
other bare cycles. □ 
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A. 5. The matrix logarithm. Proof. In this section, we consider a matrix 
M e i^DxD eigenvalue on the negative real axis. To prove Theorem 13.51 we 

write the matrix logarithm as log M = — X^^iC"'^)"/'^- This series only converges 
if ||l — M|| < 1; nevertheless, the end result of this proof can be extended to matrices 
of arbitrary norm by analytic continuation. Theorem 13.51 is therefore valid for all 
matrices regardless of norm. We introduce the auxiliary matrix M = I — M and 
rewrite the power series as 

oo 

(logM)^^ = -^- J2 M^,,. •••M,3,,M,,„, (A.25a) 

71 = 1 Wso;„^:„ 

oo ^ n 

= -E^E E E {^.Y'"''M^,„r-{M,._rM,,4M^Y\ (A.25b) 

n=l m=0 Wgg:cu,-m {pij/n-m 

with Q the graph of the partition of M . The second equality is obtained by making the 
loops explicit through the same procedure as in Just as in the previous sections, 

the loop numbers form a weak composition of n — m. For any such composition, the 
following identity holds: 



1 

n 



dx. (A.26) 



This identity allows the contributions from the infinite loop sums in Eq. (jA.25bp to 
be evaluated in closed form. By restructuring the double summation we obtain 



(logM)^^ = -<5„„ / M„[l-a;M„] ' dx (A.27) 



"EE / [I-^M^,]"'m^,„ [l-xM„]"' dx, 

where we have written [l — xM^] ^ for J^'^oi^^tJ-)^ ^^'^ ^i^a is a Kronecker delta. 
Note that the first part of this expression - which represents contributions from walks 
consisting entirely of loops - has a slightly different structure to the second part, owing 
to the absence of the term with zero loops when u = a. Just as for the previously 
obtained matrix functions, the integrand of Eq. (jA.27p is a sum of walk contributions 
with effective vertex weights c^f = [l — xMf^] . On using Theorem 12.11 Eq. (|A.27|) 
transforms to 

(logM)_= (A.28a) 

/ d.T x~^ (I — Fg[a]) , w = a, 

Jo 

/ da; x^~^ Fg\{ 
Jo 



E 



PSo 

where £ the length of the path and 



-1 



Fg[a]= \-xMa-^ 2;'" Ma^^Fgy{„_..._^^_j[/i™] ••• M^3^2Fe\{a}[M2]M^2 

(A.28b) 
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with m the length of the bare cycle. Note that we have again explicitly separated 
the contribution of the loops from that of the other bare cycles. Theorem 13.51 is now 
directly obtained upon replacing M by I — M. □ 
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